Audio recording and playback apparatus

ABSTRACT

An apparatus comprising: an input configured to receive at least two audio signals, the at least two audio signals having a relative displacement between them; an orientation determiner configured to determine an audio capture orientation based on a device orientation and information concerning microphone configuration in the apparatus; and an audio output generator configured to output the at least two audio signals based on the capture orientation, such that playback of the at least two audio signals is performed based on the capture orientation.

RELATED APPLICATION

This application was originally filed as Patent Cooperation TreatyApplication No. PCT/IB2013/052855 filed Apr. 10, 2013.

FIELD

The present application relates to apparatus for audio recording andplayback. The invention further relates to, but is not limited to,apparatus for audio recording and playback within mobile devices.

BACKGROUND

Spatial audio signals are being used in greater frequency to produce amore immersive audio experience. A stereo or multi-channel recording canbe passed from the recording or capture apparatus to a listeningapparatus and replayed using a suitable multi-channel output such as amulti-channel loudspeaker arrangement and with virtual surroundprocessing a pair of stereo headphones or headset.

It would be understood that in the near future it will be possible formobile apparatus such as mobile phones to have more than twomicrophones. This offers the possibility to record real multichannelaudio. Similarly it will be possible for mobile apparatus such as mobilephones to have more than two speakers. Thus stereophonic and surroundsound audio can be reproduced in mobile devices (such as smartphones).

In other words it is or will shortly be possible that mobile deviceswill have the capacity to record (or capture) and play back stereophonicand surround sound audio. Thus mobile devices will also be capable ofpassing these audio signals from device to device and as such can employstereophonic and surround sound audio in telecommunication applicationsand also for other services such as streaming, broadcasting andmulticasting when the audio recording or capture has been performed by asuitable or capable mobile device.

SUMMARY

Aspects of this application thus provide a spatial audio capture andprocessing whereby listening orientation or video and audio captureorientation differences can be compensated for.

According to a first aspect there is provided a method comprising:generating at least two audio signals, the at least two audio signalshaving a relative displacement between them; determining a captureorientation; and outputting the at least two audio signals based on thecapture orientation, such that playback of the at least two audiosignals is performed based on the capture orientation.

Determining a capture orientation may comprise determining an audiocapture orientation based on device orientation and informationconcerning microphone configuration in a capture apparatus.

The capture orientation may be an initial capture orientation value, andoutputting the at least two audio signals based on the captureorientation may comprise outputting the at least two audio signalsaccording to an initial audio output order.

The method may further comprise: determining if the difference betweenthe capture orientation and an earlier orientation is greater than adefined value; and further outputting the capture orientation with theat least two audio signals, such that the playback of the at least twoaudio signals is performed based on the capture orientation.

The earlier orientation may be an initial orientation.

The method may further comprise: determining an audio output order forthe at least two audio signals based on the capture orientation; andfurther outputting the audio output order with the at least two audiosignals, such that the playback of the at least two audio signals isfurther performed based on the audio output order.

The method may further comprise: determining if the difference betweenthe capture orientation and the earlier orientation is greater than adefined audio output re-ordering value, and triggering the determiningof the audio output order when the difference between the captureorientation and the earlier orientation is greater than a defined audiooutput re-ordering value.

Generating the at least two audio signals having a relative displacementbetween them may comprise: generating a first of the at least two audiosignals with a first microphone at a first location; generating a secondof the at least two audio signals with a second microphone at a secondlocation, the relative displacement between the at least two audiosignals being the displacement between the first location and the secondlocation.

Generating the at least two audio signals having a relative displacementbetween them may comprise at least one of: receiving the at least twoaudio signals from a remote apparatus comprising at least twomicrophones having the relative displacement between them; and receivingthe at least two audio signals from a memory.

According to a second aspect there is provided a method comprising:receiving at least two audio signals; determining a playbackorientation; and outputting the at least two audio signals to at leasttwo speakers based on the playback orientation.

The method may further comprise receiving a capture orientationassociated with the at least two audio signals, and wherein outputtingthe at least two audio signals to the at least two speakers is furtherbased on the capture orientation.

The method may further comprise: receiving an audio output order for theat least two audio signals based on the capture orientation, whereinoutputting the at least two audio signals to the at least two speakersis further based on the audio output order.

Outputting the at least two audio signals to at least two speakers maycomprise at least one of: routing the at least two audio signals to theat least two speakers based on the playback orientation; and mixing theat least two audio signals to generate a downmixed audio signal to beoutput to at least one of the at least two speakers.

The at least two speakers may comprise at least one of: a loudspeaker; aheadphone; a headset; an earpiece set; an external loudspeaker; and anintegrated hands free speaker.

According to a third aspect there is provided an apparatus comprising atleast one processor and at least one memory including computer code forone or more programs, the at least one memory and the computer codeconfigured to with the at least one processor cause the apparatus to atleast: generate at least two audio signals, the at least two audiosignals having a relative displacement between them; determine a captureorientation; and output the at least two audio signals based on thecapture orientation, such that playback of the at least two audiosignals is performed based on the capture orientation.

Determining a capture orientation may cause the apparatus to determinean audio capture orientation based on device orientation and informationconcerning microphone configuration in the capture apparatus.

The capture orientation may be an initial capture orientation value, andoutputting the at least two audio signals based on the captureorientation may cause the apparatus to output the at least two audiosignals according to an initial audio output order.

The apparatus may be further caused to: determine if the differencebetween the capture orientation and an earlier orientation is greaterthan a defined value; and further output the capture orientation withthe at least two audio signals, such that the playback of the at leasttwo audio signals is performed based on the capture orientation.

The earlier orientation may be an initial orientation.

The apparatus may be further caused to: determine an audio output orderfor the at least two audio signals based on the capture orientation; andfurther outputting the audio output order with the at least two audiosignals, such that the playback of the at least two audio signals isfurther performed based on the audio output order.

The apparatus may be further caused to: determine the difference betweenthe capture orientation and the earlier orientation is greater than adefined audio output re-ordering value, and trigger the determining ofthe audio output order when the difference between the captureorientation and the earlier orientation is greater than a defined audiooutput re-ordering value.

Generating the at least two audio signals having a relative displacementbetween them may cause the apparatus to: generate a first of the atleast two audio signals with a first microphone at a first location; andgenerate a second of the at least two audio signals with a secondmicrophone at a second location, the relative displacement between theat least two audio signals being the displacement between the firstlocation and the second location.

Generating the at least two audio signals having a relative displacementbetween them may cause the apparatus to perform at least one of; receivethe at least two audio signals from a remote apparatus comprising atleast two microphones having the relative displacement between them; andreceive the at least two audio signals from a memory.

According to a fourth aspect there is provided an apparatus comprisingat least one processor and at least one memory including computer codefor one or more programs, the at least one memory and the computer codeconfigured to with the at least one processor cause the apparatus to;receive at least two audio signals; determine a playback orientation;and output the at least two audio signals to at least two speakers basedon the playback orientation.

The apparatus may be further caused to receive a capture orientationassociated with the at least two audio signals, and wherein outputtingthe at least two audio signals to the at least two speakers is furtherbased on the capture orientation.

The apparatus may be further caused to: receive an audio output orderfor the at least two audio signals based on the capture orientation,wherein outputting the at least two audio signals to the at least twospeakers may be further based on the audio output order.

Outputting the at least two audio signals to at least two speakers maycause the apparatus to perform at least one of: route the at least twoaudio signals to the at least two speakers based on the playbackorientation; and mix the at least two audio signals to generate adownmixed audio signal to be output to at least one of the at least twospeakers.

The at least two speakers comprise at least one of: a loudspeaker; aheadphone; a headset; an earpiece set; an external loudspeaker; and anintegrated hands free speaker.

According to a fifth aspect there is provided an apparatus comprising:means for generating at least two audio signals, the at least two audiosignals having a relative displacement between them; means fordetermining a capture orientation; and means for outputting the at leasttwo audio signals based on the capture orientation, such that playbackof the at least two audio signals is performed based on the captureorientation.

The means for determining a capture orientation may comprise means fordetermining an audio capture orientation based on device orientation andinformation concerning microphone configuration in the captureapparatus.

The capture orientation may be an initial capture orientation value, andthe means for outputting the at least two audio signals based on thecapture orientation may comprise means for outputting the at least twoaudio signals according to an initial audio output order.

The apparatus may further comprise: means for determining if thedifference between the capture orientation and an earlier orientation isgreater than a defined value; and the means for outputting may comprisemeans for outputting the capture orientation with the at least two audiosignals, such that the playback of the at least two audio signals isperformed based on the capture orientation.

The earlier orientation may be an initial orientation.

The apparatus may further comprise: means for determining an audiooutput order for the at least two audio signals based on the captureorientation; and the means for outputting may comprise means for furtheroutputting the audio output order with the at least two audio signals,such that the playback of the at least two audio signals is furtherperformed based on the audio output order.

The apparatus may further comprise: means for determining the differencebetween the capture orientation and the earlier orientation is greaterthan a defined audio output re-ordering value, and means for triggeringthe determining of the audio output order when the difference betweenthe capture orientation and the earlier orientation is greater than adefined audio output re-ordering value.

The means for generating the at least two audio signals having arelative displacement between them may comprise: means for generating afirst of the at least two audio signals with a first microphone at afirst location; and means for generating a second of the at least twoaudio signals with a second microphone at a second location, therelative displacement between the at least two audio signals being thedisplacement between the first location and the second location.

The means for generating the at least two audio signals having arelative displacement between them may comprise at least one of: meansfor receiving the at least two audio signals from a remote apparatuscomprising at least two microphones having the relative displacementbetween them; and means for receiving the at least two audio signalsfrom a memory.

According to a sixth aspect there is provided an apparatus comprising:means for receiving at least two audio signals; means for determining aplayback orientation; and means for outputting the at least two audiosignals to at least two speakers based on the playback orientation.

The apparatus may further comprise means for receiving a captureorientation associated with the at least two audio signals, and whereinthe means for outputting the at least two audio signals to the at leasttwo speakers is further based on the capture orientation.

The apparatus may further comprise: means for receiving an audio outputorder for the at least two audio signals based on the captureorientation, wherein the means for outputting the at least two audiosignals to the at least two speakers may be further based on the audiooutput order.

The means for outputting the at least two audio signals to at least twospeakers may comprise at least one of: means for routing the at leasttwo audio signals to the at least two speakers based on the playbackorientation; and means for mixing the at least two audio signals togenerate a downmixed audio signal to be output to at least one of the atleast two speakers.

The at least two speakers comprise at least one of: a loudspeaker; aheadphone; a headset; an earpiece set; an external loudspeaker; and anintegrated hands free speaker.

According to a seventh aspect there is provided an apparatus comprising:an input configured to receive at least two audio signals, the at leasttwo audio signals having a relative displacement between them; anorientation sensor determiner configured to determine an audio captureorientation based on device orientation and information concerningmicrophone configuration in the capture apparatus; and an audio outputgenerator configured to output the at least two audio signals based onthe capture orientation, such that playback of the at least two audiosignals is performed based on the capture orientation.

The capture orientation may be an initial capture orientation value, andthe audio output generator may be configured to output the at least twoaudio signals according to an initial audio output order.

The apparatus may further comprise: an orientation comparator configuredto determine if the difference between the capture orientation and anearlier orientation is greater than a defined value; and an audioorientation signal generator configured to further output the captureorientation with the at least two audio signals, such that the playbackof the at least two audio signals is performed based on the captureorientation.

The earlier orientation may be an initial orientation.

The audio output generator may be configured to determine an audiooutput order for the at least two audio signals based on the captureorientation; and further be configured to output the audio output orderwith the at least two audio signals, such that the playback of the atleast two audio signals is further performed based on the audio outputorder.

The apparatus may comprise: an orientation comparator configured todetermine the difference between the capture orientation and the earlierorientation is greater than a defined audio output re-ordering value,and further be configured to trigger the determining of the audio outputorder when the difference between the capture orientation and theearlier orientation is greater than a defined audio output re-orderingvalue.

The input may be coupled to a first microphone configured to generate afirst of the at least two audio signals at a first location; and asecond microphone configured to generate a second of the at least twoaudio signals with a second microphone at a second location, therelative displacement between the at least two audio signals being thedisplacement between the first location and the second location.

The input may comprise at least one of: an input configured to receivethe at least two audio signals from a remote apparatus comprising atleast two microphones having the relative displacement between them; andan input configured to receive the at least two audio signals from amemory.

According to an eighth aspect there is provided an apparatus comprising:an input configured to receive at least two audio signals; a channelselector configured to determine a playback orientation; and a channelswitch configured to output the at least two audio signals to at leasttwo speakers based on the playback orientation.

The channel selector may be further configured to receive a captureorientation associated with the at least two audio signals and determinea playback orientation based on the capture orientation, and wherein thechannel switch is configured to output the at least two audio signals tothe at least two speakers is further based on the capture orientation.

The channel selector may be further configured to receive an audiooutput order for the at least two audio signals based on the captureorientation, determine a playback orientation based on the audio outputorder for the at least two audio signals and capture orientation whereinthe channel switch is configured to output the at least two audiosignals to the at least two speakers may be further based on the audiooutput order.

The channel switch may comprise at least one of: a router configured toroute the at least two audio signals to the at least two speakers basedon the playback orientation; and a mixer configured to mix the at leasttwo audio signals to generate a downmixed audio signal to be output toat least one of the at least two speakers.

The at least two speakers comprise at least one of: a loudspeaker; aheadphone; a headset; an earpiece set; an external loudspeaker; and anintegrated hands free speaker.

A computer program product stored on a medium may cause an apparatus toperform the method as described herein.

An electronic device may comprise apparatus as described herein.

A chipset may comprise apparatus as described herein.

Embodiments of the present application aim to address problemsassociated with the state of the art.

SUMMARY OF THE FIGURES

For better understanding of the present application, reference will nowbe made by way of example to the accompanying drawings in which:

FIG. 1 shows schematically an apparatus suitable for being employed insome embodiments;

FIG. 2 shows schematically an example audio capture or recordingapparatus according to some embodiments;

FIG. 3 shows schematically a flow diagram of the operation of the audiocapture or recording apparatus shown in FIG. 2 according to someembodiments;

FIG. 4 shows schematically a further flow diagram of further operationsof the audio capture or recording apparatus shown in FIG. 2 according tosome embodiments;

FIG. 5 shows schematically an example audio playback apparatus accordingto some embodiments;

FIG. 6 shows schematically a flow diagram of the operation of the audioplayback apparatus shown in FIG. 5 according to some embodiments;

FIG. 7 shows schematically a further flow diagram of further operationsof the audio playback apparatus shown in FIG. 5 according to someembodiments;

FIGS. 8 to 11 show example 3 microphone capture apparatus and 3 speakerplayback apparatus orientation combinations for 90 degree rotationsaccording to some embodiments;

FIGS. 12 to 15 show example 2 microphone capture apparatus and 2 speakerplayback apparatus orientation combinations for 90 degree rotationsaccording to some embodiments;

FIGS. 16 to 19 show example 2 microphone capture apparatus and 3 speakerplayback apparatus orientation combinations for 90 degree rotationsaccording to some embodiments;

FIGS. 20 to 23 show example 3 microphone capture apparatus and 2 speakerplayback apparatus orientation combinations for 90 degree rotationsaccording to some embodiments;

FIG. 24 shows schematically an example 8 microphone capture apparatusand an example 8 speaker playback apparatus configuration according tosome embodiments;

FIG. 25 shows schematically an example 3 microphone capture apparatusconfiguration according to some embodiments;

FIG. 26 shows schematically a flow diagram of the operation of audiorecording and playback systems with arbitrary orientation sensingaccording to some embodiments;

FIG. 27 shows schematically a further flow diagram of the operation ofaudio recording and playback systems with horizontal and verticalorientation sensing according to some embodiments; and

FIG. 28 shows schematically a flow diagram of the operation of audiorecording and playback systems with quartile orientation sensingaccording to some embodiments.

EMBODIMENTS

The following describes in further detail suitable apparatus andpossible mechanisms for the provision of effective sound-field recordingand playback for example within audio-video capture and playbackapparatus operating over a wireless communications link. In thefollowing examples audio capture and playback is described. However itwould be appreciated that in some embodiments the audio capture andplayback part of an audio-video system.

As described herein mobile devices or apparatus are more commonly beingequipped with multiple microphone configurations or microphone arrayssuitable for recording or capturing the audio environment or audio scenesurrounding the mobile device or apparatus. A multiple microphoneconfiguration enables the recording of stereo or surround sound signals.

However such mobile devices or apparatus (such as smart phones) arelimited in both the number of microphones and their location. Asadditional microphones increase size and manufacturing cost microphonescurrent designs ‘re-use’ microphones for different applications. Forinstance, microphone locations at the ‘bottom’ and ‘top’ ends can beemployed to pick up speech and reference noise in the hand-portabletelephone application of the phone and these microphones reused invideo/audio recording applications.

Similarly mobile devices or apparatus are more commonly being equippedwith multiple speaker configurations suitable for generating a suitableaudio environment or audio scene in stereo or multichannel audioformats. However such mobile devices or apparatus (such as smart phones)are also limited in both the number of microphones and their location.There are similar constraints to those for microphones as additionalspeakers increase size and manufacturing cost.

Therefore when a mobile device is used for capturing audio, theorientation of the device has a significant impact on the quality of thecaptured audio. For example a stereophonic capable device only able tocapture stereophonic audio in one orientation relative to the phone(such as horizontal or vertical orientation due to the location of themicrophones) will mean that changing the orientation of the device willalso change the ‘orientation’ of the captured stereophonic audio signal.

For example when capturing video and audio (e.g. during video-telephonycalls) the user may sometimes prefer capturing video in portraitorientation and sometimes in landscape orientation, and change betweenthese even during the same call. This can cause issues when the playbackor rendering device is unaware of the orientation of the audio capturedevice and may prevent the correct playback of the stereophonic audiosignal. This can therefore reduce the audio quality at the receivingend.

There have been suggested solutions for signaling the orientation of avideo capturing device during video capture to guarantee that thecaptured video image is played in a correct orientation at the receiverduring the call without the receiving party needing to manually rotatethe playback device to match the capturing device. Furthermore rotatingthe captured video into a new orientation at the playback device or atreceiver side is a relatively simple task since all of the informationneeded for the rotation exists in the captured video signal. However,the capture/rendering of audio is typically limited to certainorientation (due to the limited number of microphones/speakers and theirrestricted positions on the device) and may not therefore enable “free”rotation of the captured audio signal at the playback device.

Furthermore the correction of video orientation in future devices usingthe GSMA Rich Communications Suite (RCS) 5.1 does not properly correctthe audio orientation (i.e. the orientation of the captured audiosignal) and can make the situation worse since the correction methodsproposed may result into the audio and video orientations being out ofsynchronization (for example a sound source shown at the top of thescreen being played out from a speaker located at the right or left handside of the screen, or the sound source at the left hand side of thescreen being played out from the right hand side of the screen).

Thus the concept as described herein in further detail is one which theaudio recording system provides optimal pick up and stereo imaging forthe desired recording distance whilst minimizing the number ofmicrophones and taking into account limitations in microphonepositioning.

The concept as described in further detail herein is to provide asolution to align the use of speakers of the playback or rendering(receiving) device (or headphones or external loudspeakers) to the useof microphones in the recording or capturing (sending) device.

This is achieved in some embodiments by signaling the orientation ofaudio recording (capture) from the sending device to the receivingdevice. The signaling in some embodiments can be performed as part ofthe audio data and sent throughout the transmission or as additionalinformation sent only when the orientation of audio capture changes orwhen audio capture is performed at non-default orientation (such asvertical capture for stereophonic audio).

In some embodiments as described in further detail herein the conceptextends to apparatus and methods for providing the best possible audioquality at the rendering device when misalignment of audio orientationoccurs between the capturing and rendering devices.

It would be understood that as described herein the orientation of theaudio capture device (at the sending side) is detected by using agravity sensor and by having knowledge of the audio capture propertiesof the device (in other words the number of the microphones and theirpositions together with knowledge about which microphones are used forwhich device orientation). In some embodiments the inclusion ofsignaling audio orientation can be performed by using Real Time Protocol(RTP) header extension.

In this regard reference is first made to FIG. 1 which shows a schematicblock diagram of an exemplary apparatus or electronic device 10, whichmay be used to record (or operate as a capture apparatus) or playback(or operate as a rendering apparatus) audio signals.

The electronic device 10 may for example be a mobile terminal or userequipment of a wireless communication system when functioning as therecording apparatus or listening apparatus. In some embodiments theapparatus can be an audio player or audio recorder, such as an MP3player, a media recorder/player (also known as an MP4 player), or anysuitable portable apparatus suitable for recording audio or audio/videocamcorder/memory audio or video recorder.

The apparatus 10 can in some embodiments comprise an audio-videosubsystem. The audio-video subsystem for example can comprise in someembodiments a microphone or array of microphones 11 for audio signalcapture. In some embodiments the microphone or array of microphones canbe a solid state microphone, in other words capable of capturing audiosignals and outputting a suitable digital format signal in other wordsnot requiring an analogue-to-digital converter. In some otherembodiments the microphone or array of microphones 11 can comprise anysuitable microphone or audio capture means, for example a condensermicrophone, capacitor microphone, electrostatic microphone, electretcondenser microphone, dynamic microphone, ribbon microphone, carbonmicrophone, piezoelectric microphone, or micro electrical-mechanicalsystem (MEMS) microphone. The microphone 11 or array of microphones canin some embodiments output the audio captured signal to ananalogue-to-digital converter (ADC) 14.

In some embodiments the apparatus can further comprise ananalogue-to-digital converter (ADC) 14 configured to receive theanalogue captured audio signal from the microphones and outputting theaudio captured signal in a suitable digital form. Theanalogue-to-digital converter 14 can be any suitable analogue-to-digitalconversion or processing means. In some embodiments where themicrophones are ‘integrated’ microphones the microphones contain bothaudio signal generating and analogue-to-digital conversion capability.

In some embodiments the apparatus 10 audio-video subsystem furthercomprises a digital-to-analogue converter 32 for converting digitalaudio signals from a processor 21 to a suitable analogue format. Thedigital-to-analogue converter (DAC) or signal processing means 32 can insome embodiments be any suitable DAC technology.

Furthermore the audio-video subsystem can comprise in some embodiments aspeaker 33. The speaker 33 can in some embodiments receive the outputfrom the digital-to-analogue converter 32 and present the analogue audiosignal to the user. In some embodiments the speaker 33 can berepresentative of multi-speaker arrangement, a headset, for example aset of headphones, or cordless headphones.

In some embodiments the apparatus audio-video subsystem comprises acamera 51 or image capturing means configured to supply to the processor21 image data. In some embodiments the camera can be configured tosupply multiple images over time to provide a video stream.

In some embodiments the apparatus audio-video subsystem comprises adisplay 52. The display or image display means can be configured tooutput visual images which can be viewed by the user of the apparatus.In some embodiments the display can be a touch screen display suitablefor supplying input data to the apparatus. The display can be anysuitable display technology, for example the display can be implementedby a flat panel comprising cells of LCD, LED, OLED, or ‘plasma’ displayimplementations.

Although the apparatus 10 is shown having both audio/video capture andaudio/video presentation components, it would be understood that in someembodiments the apparatus 10 can comprise only the audio capture oraudio presentation parts of the audio subsystem such that in someembodiments of the apparatus the microphone (for audio capture) or thespeaker (for audio playback or presentation) are present.

In some embodiments the apparatus 10 comprises a processor 21. Theprocessor 21 is coupled to the audio-video subsystem and specifically insome examples the analogue-to-digital converter 14 for receiving digitalsignals representing audio signals from the microphone 11, thedigital-to-analogue converter (DAC) 12 configured to output processeddigital audio signals, the camera 51 for receiving digital signalsrepresenting video signals, and the display 52 configured to outputprocessed digital video signals from the processor 21.

The processor 21 can be configured to execute various program codes. Theimplemented program codes can comprise for example audio recording andaudio presentation routines according to some embodiments as describedherein. In some embodiments the program codes can be configured toperform audio signal processing.

In some embodiments the apparatus further comprises a memory 22. In someembodiments the processor is coupled to memory 22. The memory can be anysuitable storage means. In some embodiments the memory 22 comprises aprogram code section 23 for storing program codes implementable upon theprocessor 21. Furthermore in some embodiments the memory 22 can furthercomprise a stored data section 24 for storing data, for example datathat has been encoded in accordance with the application or data to beencoded via the application embodiments as described later. Theimplemented program code stored within the program code section 23, andthe data stored within the stored data section 24 can be retrieved bythe processor 21 whenever needed via the memory-processor coupling.

In some further embodiments the apparatus 10 can comprise a userinterface 15. The user interface 15 can be coupled in some embodimentsto the processor 21. In some embodiments the processor can control theoperation of the user interface and receive inputs from the userinterface 15. In some embodiments the user interface 15 can enable auser to input commands to the electronic device or apparatus 10, forexample via a keypad, and/or to obtain information from the apparatus10, for example via a display which is part of the user interface 15.The user interface 15 can in some embodiments as described hereincomprise a touch screen or touch interface capable of both enablinginformation to be entered to the apparatus 10 and further displayinginformation to the user of the apparatus 10.

In some embodiments the apparatus further comprises a transceiver 13,the transceiver in such embodiments can be coupled to the processor andconfigured to enable a communication with other apparatus or electronicdevices, for example via a wireless communications network. Thetransceiver 13 or any suitable transceiver or transmitter and/orreceiver means can in some embodiments be configured to communicate withother electronic devices or apparatus via a wire or wired coupling.

The transceiver 13 can communicate with further apparatus by anysuitable known communications protocol, for example in some embodimentsthe transceiver 13 or transceiver means can use a suitable universalmobile telecommunications system (UMTS) protocol, a wireless local areanetwork (WLAN) protocol such as for example IEEE 802.X, a suitableshort-range radio frequency communication protocol such as Bluetooth, orinfrared data communication pathway (IRDA).

In some embodiments the apparatus comprises a position sensor 16configured to estimate the position of the apparatus 10. The positionsensor 16 can in some embodiments be a satellite positioning sensor suchas a GPS (Global Positioning System), GLONASS or Galileo receiver.

In some embodiments the positioning sensor can be a cellular ID systemor an assisted GPS system.

In some embodiments the apparatus 10 further comprises a direction ororientation sensor. The orientation/direction sensor can in someembodiments be an electronic compass, accelerometer, gyroscope orgravity sensor or be determined by the motion of the apparatus using thepositioning estimate.

It is to be understood again that the structure of the electronic device10 could be supplemented and varied in many ways.

With respect to FIG. 2 an example audio capture or recording apparatusconfiguration is shown according to some embodiments. Furthermore withrespect to FIGS. 3 and 4 the operation of some embodiments of the audiocapture or recording apparatus shown in FIG. 2 is shown in furtherdetail.

In some embodiments the apparatus comprises the array of microphones 11configured to record or capture the acoustic waves and generate an audiosignal for each microphone which can be passed or input to the audiocapture apparatus. As described herein in some embodiments themicrophones 11 are configured to output an analogue signal which isconverted into digital format by the analogue to digital converter (ADC)14. However the microphones shown in the example herein are integratedmicrophones configured to output a digital format directly to amicrophone order generator 103.

In the example shown herein there are N microphones. These microphonescan be arranged in some embodiments in any suitable manner. However anexample microphone configuration can be shown with respect to FIG. 25where three microphones are distributed over the apparatus. As shown inFIG. 25 the apparatus comprises three microphones. The first microphone(right microphone) 11 ₁, and a second microphone (left microphone) 11 ₂are located on the same ‘vertical’ plane on the same side of theapparatus as the camera hereby referred to as the front of the device.Furthermore the apparatus comprises a third microphone (left rearmicrophone) 11 ₃ which is located on the same or similar horizontalplane on the opposite side to the front side containing the camera. Inother words in conventional use where the camera is located on theopposite side to the display which typically faces of the user in usethe left rear microphone 11 ₃ is the conventional voice call microphone,and the first and second microphones the noise reducing microphonesconfigured to capture the noise to apply noise reduction or cancellationto the voice call audio signals.

Although in the example shown in FIG. 25 that there are threemicrophones it would be understood that in some embodiments there can bemore than or fewer than three microphones and the microphones can bearranged or located on the apparatus in any suitable manner. For exampleFIG. 24 shows an eight microphone configuration wherein eightmicrophones are located on a surface of the apparatus at 45° anglesaround a defined circle. Thus for example a first microphone is locatedat 0°, a second microphone at 45°, a third microphone at 90°, a fourthmicrophone at 135°, a fifth microphone at 180°, a sixth microphone at225°, and a seventh microphone phone at 270°, and an eighth microphoneat 315°. The multi-microphone configuration may be located on non-flatsurface on the apparatus or be spread into more than one surface/side ofthe apparatus.

Furthermore although as shown in FIG. 2, and FIGS. 24 and 25 that themicrophones are part of the apparatus it would be understood that insome embodiments the microphones or microphone array is physicallyseparate from the apparatus, for example the microphone array can belocated on a headset (where optionally the headset can have anassociated video camera) which wirelessly or otherwise passes the audiosignals to the apparatus for processing. Furthermore although it wouldbe understood that the audio signals are generated in real-time by themicrophones, in other words that there is generated at least two audiosignals, the at least two audio signals having a relative displacementbetween them, that in some embodiments these audio signals can beunderstood to be received from a storage device or memory. For examplein some embodiments the ‘generating’ the audio signals can be fromrecorded and stored audio signals (for example in an off-line signalprocessing application).

The operation of receiving or generating the audio signals is shown inFIGS. 3 and 4 by step 201.

In some embodiments the apparatus comprises a gravity/orientation sensor16. As described herein the gravity/orientation sensor 16 can be anysuitable device or means for generating a signal and value whichrepresents the apparatus orientation relative to a defined level. In thefollowing examples the gravity/orientation sensor 16 defines a value orgenerates a value of the apparatus with respect to the vertical planeand the level.

However it would be understood that in some embodiments thegravity/orientation sensor 16 is configured to determine the orientationin more than one plane, in other words to determine a roll, pitch andyaw rotation value. Furthermore it would be understood that although theembodiments as described herein describe the use or implementation of aroll orientation about the horizontal plane similar methods could beapplied to pitch and yaw rotations or a combination of at least two ofthese.

The operation of receiving or generating orientation information isshown in FIG. 3 and FIG. 4 by step 203.

The gravity/orientation sensor 16 can in some embodiments output theorientation information to the audio orientation signal generator 101and microphone order generator 103.

In some embodiments the apparatus comprises an audio orientation signalgenerator 101. The audio orientation signal generator 101 is configuredto receive the gravity/orientation sensor 16 output and determinefirstly whether an audio orientation signal is to be generated andsecondly the audio orientation signal to be output.

In some embodiments the audio orientation signal generator 101 isconfigured to receive the orientation information.

The audio orientation signal generator is configured to determine anaudio orientation signal. In some embodiments this is generated whateverthe orientation value is. However in some embodiments the determinationof audio orientation signal (in other words whether an orientationsignal is to be output to the receiving or playback apparatus) is basedon the audio orientation information. For example in some embodimentsthe audio orientation signal generator 101 can be configured to generateand transmit a signal to the receiving or playback apparatus comprisingthe orientation value of the audio capture where the orientation of thecapture is greater than a determined threshold from a determined‘default’ audio orientation. The ‘default’ orientation can be anysuitable audio orientation though typically it is horizontalorientation. In some embodiments the threshold for determining whetherto change the audio orientation of capture (i.e. signal the audioorientation value) can be 45 degrees from the default orientation, thisthreshold determining whether the audio capture is considered at thereceiver as orientated horizontally or vertically. Suitable hysteresisshould be applied to avoid audio being oscillating between twoorientations at the receiving device. In some embodiments the thresholdfor determining whether to signal the audio orientation value can bemore or less than 45 degrees. It would be understood that the audioorientation is also known as a capture orientation or an audio captureorientation. It would be further understood that in some embodimentsdetermining the capture orientation may comprise determining an audiocapture orientation based on device orientation and informationconcerning microphone configuration in a capture apparatus. In otherwords that the audio orientation signal generator can be configured toreceive information concerning the microphone configuration, such as thenumber of microphones, the position of the microphones and a relativepositioning of the microphones and/or the device on which themicrophones are attached. In some embodiments the information canfurther include the capture directionality of the microphone (is themicrophone a directional or omnidirectional microphone) and where themicrophone is directional the orientation of the capture directionality.

The operation of determining whether the determined orientation requiresan audio orientation signal is shown in FIG. 3 by step 205.

The audio orientation signal generator 101 can then in some embodimentsbe configured to generate a suitable audio orientation signal. The audioorientation signal in some embodiments comprises an indicator of theorientation angle. For example in some embodiments the audio orientationsignal comprises a quantised version of the audio orientation signal.The audio orientation signal can for example comprise the indicationthat the audio capture is orientated either horizontally or verticallyin other words the audio orientation signal is the orientation value ofthe recording with 90° orientation quantisation but having noinformation on which side is which in the vertical or horizontal plane.In such embodiments the audio orientation signal can require only onebit to signal this information but the capturing and rendering devicesmust be aware of the audio output order i.e. which signal is sent firstin horizontal capture (audio output order “left, right” or “right,left”) and in vertical capture (audio output order: “top, bottom” or“bottom, top”). “Audio output order” means the order (in the bit-stream)in which the audio outputs are sent from the capturing device to thereceiving device.

In some embodiments the audio orientation signal can for examplecomprise the indication that the audio capture is orientated eithervertically, vertically rotated with 180 degrees, horizontally,horizontally rotated with 180 degrees. In other words the audioorientation signal is the orientation value of the recording or capturewith quartile quantisation (or outputting a value of 0°, 90°, 180°, or270° orientation which can be signalled using 2 bits. In this case, theaudio output order can be signalled by the audio orientation signalitself. In some embodiments more accurate quantization may be used, e.g.0°, 45°, 90°, 135°, 180° . . . 315° which can be signalled using 3 bits,

However it would be understood that the audio orientation informationcan be in any suitable format or form or quantisation level. In someembodiments the signalling of the audio orientation information isprovided as metadata with the audio signals. For example in non-realtime recordings where the audio signals are to be received/downloadedfrom external sources and the orientation data is provided in metadata.

In some embodiments the signaling of audio orientation can be performedby embedding the orientation value within any suitable message orprotocol and transmitting this to the receiving or playback device. Insome embodiments the orientation value can be embedded within a realtime protocol (RTP) header extension. For example the signaling of theaudio orientation can be carried out over an internet protocol (IP)connection by using the RTP header extension in a manner as explained inIETF RFC 5285 “A General Mechanism for RTP Header Extensions”. Anexample RTP header extension, with one extension element, some padding,and including the required RTP fields is given below. This supportssending the audio orientation signaling (AOS) data (specifying theorientation of audio capture e.g. in degrees) with 8 bits for each RTPframe. This should be enough to support any practical granularity foraudio orientation.

In some embodiments the AOS data is sent only after determining a changein audio orientation to avoid adding too much overhead into the overalltransmission data.

However it would be understood that in some embodiments the generationand/or transmission of AOS data is a regular or continuous operation.

In some embodiments an extended AOS data, containing not onlyinformation of the orientation of audio capture but also configurationinformation, is transmitted at the session setup negotiation stage. InIP-based services such setup negotiation can be performed using SessionDescription Protocol (SDP) and the layout or configuration of themicrophones (Le, their number and positions in the capture or sendingdevice and any other relevant configuration information) is detailed tothe receiver. In such embodiments, solely based on device orientationsignaling, the playback or receiver device is made aware of not only theorientation of sending device but also of the orientation of the audiocapture in the sending device, and therefore sending any further AOSdata after the setup may not be needed In some embodiments any furthercapture device orientation (or at least changes in the orientation) canthen be generated and transmitted from the capture or sender device tothe playback or receiving device. It would be understood that the SDPembodiments attempt to reduce the signaling overhead, but requiredefinition of “common language” in other words the introduction of a newSDP parameter on how the microphone layout is described by the sendingdevice and transferred to the receiving device.

The operation of generating the audio orientation signal is shown inFIG. 3 by step 207.

Furthermore the audio orientation signal generator can then beconfigured to output the audio orientation signal (AOS data) which isoutput at the same time that the microphone order generator 103 orcapture apparatus in general outputs the audio signals (or in someembodiments the microphones output the audio signals themselves).

The operation of outputting the audio orientation signal with audiosignals is shown in FIG. 3 by step 209.

Where the audio orientation signal generator 101 determines that noorientation signal is to be output then the audio orientation signalgenerator is configured not to output an audio orientation signal. Thusin some embodiments the recording device or apparatus outputs only theaudio signals.

The operation of outputting only the audio signals is shown in FIG. 3 bystep 211.

In some embodiments the determination of whether an audio orientationsignal is to be generated or transmitted can be performed not only onthe orientation of the capture or recording device but furthermore onthe microphone configuration of the capture or recording device. Forexample it would be understood that the orientation of the capture orrecording apparatus may not be problematic for any orientation of thecapture or recording apparatus providing certain criteria are met withrespect to the configuration of the capture apparatus, the playbackapparatus (including the orientation of the playback apparatus), and themanner that the audio signals are transmitted.

Thus for example in some embodiments the audio orientation signalgenerator 101 is configured to determine whether given informationconcerning capture apparatus microphone configuration (for example themicrophone number and location of the microphones) that the orientationof the device could be problematic in terms of audio signal playback.

In some embodiments the audio orientation signal generator 101 isconfigured to assume that the output device speaker configuration is thesame as the current recording device however as described herein in someembodiments the audio orientation signal generator 101 can receiveinformation from the playback device concerning the speakerconfiguration (and in some embodiments concerning the orientation or theplayback apparatus) and determine whether or not the microphoneconfigurations, speaker configurations, and orientation of each could beproblematic.

For example in some embodiments the audio orientation signal generator101 can use a look up table to determine whether an orientation signalis to be generated and transmitted.

In some embodiments the apparatus comprises a microphone order generator103 or audio output orderer (or suitable means for generating an audiooutput order). The microphone order generator 103 is configured toreceive the inputs from the microphones, such as shown in FIG. 25 bymicrophones 11 ₁ to 11 _(N) and further receive the input from thegravity/orientation sensor 16 indicating the orientation of theapparatus. In some embodiments the microphone order generator 103 can beconfigured to determine a specific audio output order or inform thereceiving or playback apparatus of a specific audio output order.

In the following examples the audio output order is leftmost channel,rightmost channel and then other channels, however any suitable audiooutput order can be implemented. For example a rightmost channel toleftmost channel, an upmost channel to downmost channel, or downmostchannel to upmost channel.

Furthermore the audio output order can be other than a linear ordering,for example in some embodiments the audio output order can be a cyclicalorder starting from a first orientation (leftmost channel) and thenordering the microphone channels as they occur clockwise (oranticlockwise).

In some embodiments the audio output order can be for more than onedimension (and so to enable pitch and yaw rotations to be considered).

In some embodiments the microphone order generator 103 is thereforeconfigured to determine the audio output order based on the knowledge ofthe locations of the microphones and the orientation sensor input.

In an example 3 microphone configuration with an apparatus in an initialorientation (0 degrees) with a first microphone L 11 ₁₁ located to thetop left of the apparatus, a second microphone R 11 ₁₂ located to thetop right of the apparatus and a third microphone L′11 ₁₃ located at thebottom left of the apparatus. In the following description top andbottom are with reference to a normal interpretation of relativepositions or elements being at a highest gravitational potential andlowest gravitational potential respectively. However it would beunderstood that in some embodiments the top and bottom refer to relativeopposite positions or elements in any suitable vector. Thus similarly insome embodiments top and bottom can be referred to as up and down.

Furthermore in the following examples where there is the choice betweentwo microphones, for example there are two microphones located at thesame or similar horizontal distances from a third microphone, then theone with the smallest vertical distance from the third microphone shouldbe put first (of the two) in the audio output order. In other words inthis example where possible the first microphone is selected as beingthe furthest left microphone over the others and the second microphoneis selected as being the furthest right microphone over the thirdmicrophone. In addition, the audio output order is to be made based onthe orientation (of the highest separation) as indicated by AOS i.e. inthe case of vertical capture it will be based on which microphone islocated upmost and which is located downmost on the device (instead ofleftmost and rightmost). Also this is shown in the following examples.It would be understood that any suitable selection order can be used.

Thus for an initial 0 degrees orientation the microphone order generatorcan be configured to generate an audio output order of L, R, L′.

A rotation of 90 degrees clockwise causes the microphone order generatorto generate an audio output order of L′, L, R.

A further rotation of 90 degrees clockwise, in other words a 180 degreesfrom the initial orientation causes the microphone order generator togenerate an audio output order of R, L, L′.

Furthermore a further rotation of 90 degrees clockwise, in other words a270 degrees rotation clockwise from the initial orientation causes themicrophone order generator to generate an audio output order of L, L′,R.

In other words the order that a microphone audio signal occurs withinthe ordering is based on the orientation value of the apparatus. In someembodiments this ordering can be determined based on a look up table ofinput orientation sensor values.

The operation of determining an audio output order based on theorientation information is shown in FIG. 4 by step 301.

Furthermore in some embodiments the microphone order generator 103 isconfigured to output the audio signals in the determined audio outputorder.

In other words the microphone audio signal associated with the firstelement on the ordering is output as the first output channel 105 ₁, themicrophone audio signal associated with the second element on theordering is output as the second output channel 105 ₂ and so on.

It would be understood that in some embodiments there can be more orfewer output channels than there are microphone audio signals.

The operation of outputting the audio signals in a determinedorientation order is shown in FIG. 4 by step 303.

In some embodiments the microphone order generator 103 outputs themicrophone audio signals in the originally received order and instead ofchanging the audio output order is configured to output the audio outputorder as a message or signal it to the receiver or playback apparatus.

Furthermore in some embodiments there is no microphone order generatorwithin the recording or capture apparatus. However in such embodimentsthe operation of the microphone order generator can be achieved withinthe receiving or playback apparatus having received or determined signalindicating the orientation of the capture apparatus and also havingreceived the microphone configuration information, for example in a SDPmessage as extended AOS data, like explained earlier.

Example audio output ordering and audio orientation signal generationsituations can be shown with respect to FIGS. 8 to 11 where an example 3microphone configuration for the capture or recording apparatus is shownand an example 3 speaker configuration for the playback or renderingapparatus is shown for orientation steps of 90°.

In the example 3 microphone configuration the initial orientation (0degrees) is in portrait orientation with a first microphone L 11 ₁₁located to the top left of the apparatus, a second microphone R 11 ₁₂located to the top right of the apparatus and a third microphone L′ 11₁₃ located at the bottom left of the apparatus.

Similarly in the example 3 speaker configuration the initial orientation(0 degrees) is in portrait orientation with a first speaker 33 ₁₁located to the top left of the apparatus, a second speaker 33 ₁₂ locatedto the top right of the apparatus and a third speaker 33 ₁₃ located atthe bottom left of the apparatus.

FIG. 8 for example shows the four situations where the recording orcapture apparatus (sender apparatus) is in initial orientation and theplayback or rendering apparatus (receiver apparatus) is rotated with 90degree granularity (where the rotation is measured clockwise indegrees). The microphone order generator can in these four situations beconfigured to generate an audio output order of L, R, L′. In theseembodiments the audio outputs are correctly ordered or labelled suchthat the left(most) channel audio signal is that generated by the firstmicrophone 11 ₁₁ L and the right(most) channel audio signal is thatgenerated by the second microphone 11 ₁₂ R. It would be understood thatin some embodiments the left(most) channel audio signal can be thatgenerated by the third microphone 11 ₁₃ L′. FIG. 8 shows that despitethe rotation of the playback apparatus there is no problem in playbackand as such in some embodiments there is no need to send AOS data.

FIG. 9 shows the four situations where the recording or captureapparatus (sender apparatus) is 90 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of L′, L, R.In these embodiments the audio outputs are correctly ordered or labelledsuch that the left(most) channel audio signal is that generated by thethird microphone 11 ₁₃ L′ and the right(most) channel audio signal isthat generated by the first microphone 11 ₁₁ L. It would be understoodthat in some embodiments the right(most) channel audio signal can bethat generated by the second microphone 11 ₁₂ R. FIG. 9 shows thatdespite the rotation of the capture apparatus and playback apparatusthere is no problem and as such in some embodiments there is no need tosend AOS data (provided the audio outputs are correctly ordered orlabelled).

FIG. 10 shows the four situations where the recording or captureapparatus (sender apparatus) is 180 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of R, L, L′.In these embodiments the audio outputs are correctly ordered or labelledsuch that the left(most) channel audio signal is that generated by thesecond microphone 11 ₁₂ R and the right(most) channel audio signal isthat generated by the first microphone 11 ₁₁ L. It would be understoodthat in some embodiments the right(most) channel audio signal can bethat generated by the third microphone 11 ₁₃ L′. FIG. 10 shows thatdespite the rotation of the capture apparatus and playback apparatusthere is no problem and as such in some embodiments there is no need tosend AOS data (provided the audio outputs are correctly ordered orlabelled).

FIG. 11 shows the four situations where the recording or captureapparatus (sender apparatus) is 270 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of L, L′, R.In these embodiments the audio outputs are correctly ordered or labelledsuch that the left(most) channel audio signal is that generated by thefirst microphone 11 ₁₁ L and the right(most) channel audio signal isthat generated by the third microphone 11 ₁₃ L′. It would be understoodthat in some embodiments the left(most) channel audio signal can be thatgenerated by the second microphone 11 ₁₂ R. FIG. 11 shows that despitethe rotation of the capture apparatus and playback apparatus there is noproblem and as such in some embodiments there is no need to send AOSdata (provided the audio outputs are correctly ordered or labelled).

A further example audio output ordering and audio orientation signalgeneration situations can be shown with respect to FIGS. 12 to 15 wherean example 2 microphone configuration for the capture or recordingapparatus is shown and an example 2 speaker configuration for theplayback or rendering apparatus is shown for orientation steps of 90°.

In the example 2 microphone configuration the initial orientation (0degrees) is in portrait orientation with a first microphone L 11 ₁₁located to the top left of the apparatus, and a second microphone R 11₁₂ located to the top right of the apparatus. In other words similar tothe example 3 microphone configuration shown in FIGS. 8 to 11 but withthe third microphone removed or disabled or switched off.

Similarly in the example 2 speaker configuration the initial orientation(0 degrees) is in portrait orientation with a first speaker 33 ₁₁located to the top left of the apparatus and a second speaker 33 ₁₂located to the top right of the apparatus. In other words similar to theexample 3 speaker configuration shown in FIGS. 8 to 11 but with thethird speaker 33 ₁₃ removed, disabled or switched off.

FIG. 12 for example shows the four situations where the recording orcapture apparatus (sender apparatus) is in initial orientation and theplayback or rendering apparatus (receiver apparatus) is rotated with 90degree granularity (where the rotation is measured clockwise indegrees). The microphone order generator can in these four situations beconfigured to generate an audio output order of L, R. In theseembodiments the audio outputs are correctly ordered or labelled suchthat the left(most) channel audio signal is that generated by the firstmicrophone 11 ₁₁ L and the right(most) channel audio signal is thatgenerated by the second microphone 11 ₁₂ R. FIG. 12 shows that there isno problem in playback caused by the capture apparatus and as such insome embodiments there is no need to send AOS data.

FIG. 13 shows the four situations where the recording or captureapparatus (sender apparatus) is 90 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of L, R. Inthese embodiments the audio outputs are ordered or labelled such thatthe left(most) channel audio signal is that generated by the firstmicrophone 11 ₁₁ L and the right(most) channel audio signal is thatgenerated by the second microphone 11 ₁₂ R. However the orientation ofthe recording or capture apparatus is such that there is no or verylittle horizontal separation between the first microphone 11 ₁₁ andsecond microphone 11 ₁₂ and therefore the horizontal stereo captureeffect is minimal (below a certain threshold) or there is none. FIG. 13therefore shows that the orientation of the capture apparatus can causea problem and as such AOS data is to be sent to permit the receivingapparatus or playback apparatus to allow for the lack of horizontalseparation (or vertical capture). In some embodiments, the audio outputorder is to be made based on the orientation indicated by AOS. In otherwords for the example shown in FIG. 13 the audio output order can bebased on which microphone is located upmost and which is locateddownmost on the device (instead of leftmost and rightmost).

FIG. 14 shows the four situations where the recording or captureapparatus (sender apparatus) is 180 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of R, L. Inthese embodiments the audio outputs are correctly ordered or labelledsuch that the left(most) channel audio signal is that generated by thesecond microphone 11 ₁₂ R and the right(most) channel audio signal isthat generated by the first microphone 11 ₁₁ L. FIG. 14 shows that thereis no problem in playback caused by the capture apparatus and as such insome embodiments there is no need to send AOS data (provided the audiooutputs are correctly ordered or labelled).

FIG. 15 shows the four situations where the recording or captureapparatus (sender apparatus) is 270 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of R, L. Inthese embodiments the audio outputs are ordered or labelled such thatthe left(most) channel audio signal is that generated by the secondmicrophone 11 ₁₂ R and the right(most) channel audio signal is thatgenerated by the first microphone 11 ₁₁ L. However the orientation ofthe recording or capture apparatus is such that there is no or verylittle horizontal separation between the first microphone 11 ₁₁ andsecond microphone 11 ₁₂ and therefore the horizontal stereo captureeffect is minimal (below a certain threshold) or there is none. FIG. 15therefore shows that the orientation of the capture apparatus can causea problem and as such AOS data is to be sent to permit the receivingapparatus or playback apparatus to allow for the lack of horizontalseparation (or vertical capture). In some embodiments, the audio outputorder is to be made based on the orientation indicated by AOS. In otherwords for the example shown in FIG. 15, the audio output order can bebased on which microphone is located upmost and which is locateddownmost on the device (instead of leftmost and rightmost).

A further example audio output ordering and audio orientation signalgeneration situations can be shown with respect to FIGS. 16 to 19 wherean example 2 microphone configuration for the capture or recordingapparatus is shown and an example 3 speaker configuration for theplayback or rendering apparatus is shown for orientation steps of 90°.

In the example 2 microphone configuration the initial orientation (0degrees) is in portrait orientation with a first microphone L 11 ₁₁located to the top left of the apparatus, and a second microphone R 11₁₂ located to the top right of the apparatus. In other words similar tothe example 3 microphone configuration shown in FIGS. 8 to 11 but withthe third microphone removed or disabled or switched off.

The example 3 speaker configuration (which is similar to the examplesshown in FIGS. 8 to 11) the initial orientation (0 degrees) is inportrait orientation with a first speaker 33 ₁₁ located to the top leftof the apparatus, a second speaker 33 ₁₂ located to the top right of theapparatus and a third speaker 33 ₁₃ located at the bottom left of theapparatus.

FIG. 16 for example shows the four situations where the recording orcapture apparatus (sender apparatus) is in initial orientation and theplayback or rendering apparatus (receiver apparatus) is rotated with 90degree granularity (where the rotation is measured clockwise indegrees). The microphone order generator can in these four situations beconfigured to generate an audio output order of L, R. In theseembodiments the audio outputs are correctly ordered or labelled suchthat the left(most) channel audio signal is that generated by the firstmicrophone 11 ₁₁ L and the right(most) channel audio signal is thatgenerated by the second microphone 11 ₁₂ R. FIG. 12 shows that there isno problem in playback caused by the capture apparatus and as such insome embodiments there is no need to send AOS data.

FIG. 17 shows the four situations where the recording or captureapparatus (sender apparatus) is 90 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of L, R. Inthese embodiments the audio outputs are ordered or labelled such thatthe left(most) channel audio signal is that generated by the firstmicrophone 11 ₁₁ L and the right(most) channel audio signal is thatgenerated by the second microphone 11 ₁₂ R. However the orientation ofthe recording or capture apparatus is such that there is no or verylittle horizontal separation between the first microphone 11 ₁₁ andsecond microphone 11 ₁₂ and therefore the horizontal stereo captureeffect is minimal (below a certain threshold) or there is none. FIG. 13therefore shows that the orientation of the capture apparatus can causea problem and as such AOS data is to be sent to permit the receivingapparatus or playback apparatus to allow for the lack of horizontalseparation (or vertical capture). In some embodiments the audio outputorder can be made based on the orientation indicated by AOS. In otherwords for the example as shown in FIG. 17 the output order can be basedon which microphone is located upmost and which is located downmost onthe device (instead of leftmost and rightmost).

FIG. 18 shows the four situations where the recording or captureapparatus (sender apparatus) is 180 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of R, L. Inthese embodiments the audio outputs are correctly ordered or labelledsuch that the left(most) channel audio signal is that generated by thesecond microphone 11 ₁₂ R and the right(most) channel audio signal isthat generated by the first microphone 11 ₁₁ L. FIG. 18 shows that thereis no problem in playback caused by the capture apparatus and as such insome embodiments there is no need to send AOS data (provided the audiooutputs are correctly ordered or labelled).

FIG. 19 shows the four situations where the recording or captureapparatus (sender apparatus) is 270 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of R, L. Inthese embodiments the audio outputs are ordered or labelled such thatthe left(most) channel audio signal is that generated by the secondmicrophone 11 ₁₂ R and the right(most) channel audio signal is thatgenerated by the first microphone 11 ₁₁ L. However the orientation ofthe recording or capture apparatus is such that there is no or verylittle horizontal separation between the first microphone 11 ₁₁ andsecond microphone 11 ₁₂ and therefore the horizontal stereo captureeffect is minimal (below a certain threshold) or there is none. FIG. 19therefore shows that the orientation of the capture apparatus can causea problem and as such AOS data is to be sent to permit the receivingapparatus or playback apparatus to allow for the lack of horizontalseparation (or vertical capture). In addition, the audio output order isto be made based on the orientation indicated by AOS i.e. in the case ofthis figure it will be based on which microphone is located upmost andwhich is located downmost on the device (instead of leftmost andrightmost).

A fourth example audio output ordering and audio orientation signalgeneration situations can be shown with respect to FIGS. 20 to 23 wherean example 3 microphone configuration for the capture or recordingapparatus is shown and an example 2 speaker configuration for theplayback or rendering apparatus is shown for orientation steps of 90°.

In the example 3 microphone configuration the initial orientation (0degrees) is in portrait orientation with a first microphone L 11 ₁₁located to the top left of the apparatus, a second microphone R 11 ₁₂located to the top right of the apparatus and a third microphone L′ 11₁₃ located at the bottom left of the apparatus (in other words similarto the configuration as shown in FIGS. 8 to 11).

In the example 2 speaker configuration the initial orientation (0degrees) is in portrait orientation with a first speaker L 33 ₁₁ locatedto the top left of the apparatus, and a speaker microphone R 33 ₁₂located to the top right of the apparatus. In other words similar to theexample 3 speaker configuration shown in FIGS. 8 to 11 but with thethird speaker removed or disabled or switched off (in other wordssimilar to the configuration shown in FIGS. 12 to 15).

FIG. 20 for example shows the four situations where the recording orcapture apparatus (sender apparatus) is in initial orientation and theplayback or rendering apparatus (receiver apparatus) is rotated with 90degree granularity (where the rotation is measured clockwise indegrees). The microphone order generator can in these four situations beconfigured to generate an audio output order of L, R, L′. In theseembodiments the audio outputs are correctly ordered or labelled suchthat the left(most) channel audio signal is that generated by the firstmicrophone 11 ₁₁ L and the right(most) channel audio signal is thatgenerated by the second microphone 11 ₁₂ R. It would be understood thatin some embodiments the left(most) channel audio signal can be thatgenerated by the third microphone 11 ₁₃ L′. FIG. 20 shows that there isno problem in playback caused by the capture apparatus and as such insome embodiments there is no need to send AOS data.

FIG. 21 shows the four situations where the recording or captureapparatus (sender apparatus) is 90 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of L′, L, R.In these embodiments the audio outputs are correctly ordered or labelledsuch that the left(most) channel audio signal is that generated by thethird microphone 11 ₁₃ L′ and the right(most) channel audio signal isthat generated by the first microphone 11 ₁₁ L. It would be understoodthat in some embodiments the right(most) channel audio signal can bethat generated by the second microphone 11 ₁₂ R. FIG. 21 shows thatthere is no problem in playback caused by the capture apparatus and assuch in some embodiments there is no need to send AOS data (provided theaudio outputs are correctly ordered or labelled).

FIG. 22 shows the four situations where the recording or captureapparatus (sender apparatus) is 180 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of R, L, L′.In these embodiments the audio outputs are correctly ordered or labelledsuch that the left(most) channel audio signal is that generated by thesecond microphone 11 ₁₂ R and the right(most) channel audio signal isthat generated by the first microphone 11 ₁₁ L. It would be understoodthat in some embodiments the right(most) channel audio signal can bethat generated by the third microphone 11 ₁₃ L′. FIG. 22 shows thatthere is no problem in playback caused by the capture apparatus and assuch in some embodiments there is no need to send AOS data (provided theaudio outputs are correctly ordered or labelled).

FIG. 23 shows the four situations where the recording or captureapparatus (sender apparatus) is 270 degrees clockwise from the initialorientation and the playback or rendering apparatus (receiver apparatus)is rotated with 90 degree granularity (where the rotation is measuredclockwise in degrees). The microphone order generator can in these foursituations be configured to generate an audio output order of L, L′, R.In these embodiments the audio outputs are correctly ordered or labelledsuch that the left(most) channel audio signal is that generated by thefirst microphone 11 ₁₁ L and the right(most) channel audio signal isthat generated by the third microphone 11 ₁₃ L′. It would be understoodthat in some embodiments the left(most) channel audio signal can be thatgenerated by the second microphone 11 ₁₂ R. FIG. 13 shows that there isno problem in playback caused by the capture apparatus and as such insome embodiments there is no need to send AOS data (provided the audiooutputs are correctly ordered or labelled).

With respect to FIG. 5 an example receiving or playback apparatus isshown according to some embodiments. Furthermore with respect to FIGS. 6and 7 example operations of the playback or receiving apparatus as shownin FIG. 5 are described.

In some embodiments of the receiving apparatus is configured to receivethe AOS input 403. The AOS input 403 can in some embodiments be passedto a channel selector 409.

The operation of receiving the AOS input is shown in FIG. 7 by step 503.

Furthermore in some embodiments the apparatus comprises agravity/orientation sensor 405. The gravity/orientation sensor 405 isconfigured to perform a similar role as the gravity/orientation sensordescribed in the recording or capture apparatus. The gravity/orientationsensor 405 is configured to provide an orientation output to the channelselector 409.

The operation of receiving the/determining orientation information isshown in FIGS. 6 and 7 by step 505.

In some embodiments the playback or receiving apparatus comprises achannel selector 409. The channel selector 409 can be configured toreceive the AOS input 403, and the gravity/orientation sensor outputfrom the gravity/orientation sensor 405. Furthermore in some embodimentsthe channel selector 409 can be configured to receive audio inputconfiguration/audio output order information from the capture orrecording apparatus.

In some embodiments the channel selector 409 can be configured todetermine from the orientation sensor input value and the AOS input thechannel output configurations.

It would be understood that the channel selector 409 is configured toperform this configuration having knowledge of the playback apparatusspeaker configuration. In other words with knowledge of when possibleproblems in playback can occur such as for example what orientationwould produce no horizontal separation between speakers.

In some embodiments the channel selector 409 can further be configuredto perform the channel output determination based on the audio inputconfiguration information or audio output order information passed fromthe capture or recording device. For example where the audio signalinput is not arranged in the audio output order but is effectivelyordered by the channel selector 409.

The operation of determining the channel output configurations based onthe AOS input and orientation information is shown in FIG. 7 by step601.

Furthermore in some embodiments the audio playback apparatus isconfigured to receive the audio input. The audio inputs are shown inFIG. 5 as audio input 1 401 ₁ and audio input X 401 _(x). The audioinputs are passed to the channel mixer/switch 411.

In some embodiments the receiving or playback apparatus comprises achannel mixer/switch 411. The channel mixer/switch 411 can be configuredto receive input from the channel selector 409 and mix and/or switch theaudio inputs to generate suitable audio outputs. For example as shown inFIG. 5 a first audio output 1 413 ₁ and audio output Y 413 _(Y).

The operation of mixing or switching the audio inputs to output channelsis shown in FIG. 7 by step 613.

The operation as shown in FIG. 6 differs from that shown in FIG. 7 inthat the channel selector is configured to generate the channel outputconfiguration dependent on the presence of the AOS data. In other wordsthe embodiments as shown in FIG. 6 differs from the embodiments in FIG.7 in that the apparatus as represented in the embodiments shown in FIG.6 is configured to generate channel output configuration only when theAOS data is provided where the output configuration is based on acombination of the factors of the received AOS data and the orientationinformation and otherwise the ‘initial’ orientation conditions are usedin the channel mixer/switch 411.

With respect to FIG. 7 the apparatus is configured to receive AOS dataat known periods or continuously and as such is configured to determinethe channel output configuration based on the AOS data and theorientation information.

The operation of checking for AOS data is shown in FIG. 6 by step 507.

The operation of generating channel output configurations baseddependent on the presence of AOS data is shown in FIG. 6 by step 509.

Example audio input to output configuration situations can be shown withrespect to FIGS. 8 to 11 where an example 3 microphone configuration forthe capture or recording apparatus is shown for orientation steps of 90°and an example 3 speaker configuration for the playback or renderingapparatus is shown for orientation steps of 90°.

Thus for example FIG. 8 shows that where the capture or recordingapparatus and the playback apparatus or receiver both are in initialorientation 701 the left channel audio signal L is output on the firstspeaker 33 ₁₁ and the right channel audio signal R is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 703 the left channel audio signal L is output onthe third speaker 33 ₁₃ and the right channel audio signal R is outputon the first speaker 33 ₁₁. Where the playback apparatus or receiver isrotated by 180 degrees 705 the left channel audio signal L is output onthe second speaker 33 ₁₂ and the right channel audio signal R is outputon the first speaker 33 ₁₁. Furthermore where the playback apparatus orreceiver is rotated by 270 degrees 707 the left channel audio signal Lis output on the first speaker 33 ₁₁ and the right channel audio signalR is output on the third speaker 33 ₁₃.

Thus for example FIG. 9 shows that where the recording or captureapparatus has been rotated by 90 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 801 the left channel audio signal L′ is output on the firstspeaker 33 ₁₁ and the right channel audio signal L is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 803 the left channel audio signal L′ is output onthe third speaker 33 ₁₃ and the right channel audio signal L is outputon the first speaker 33 ₁₁. Where the playback apparatus or receiver isrotated by 180 degrees 805 the left channel audio signal L′ is output onthe second speaker 33 ₁₂ and the right channel audio signal L is outputon the first speaker 33 ₁₁. Furthermore where the playback apparatus orreceiver is rotated by 270 degrees 807 the left channel audio signal L′is output on the first speaker 33 ₁₁ and the right channel audio signalL is output on the third speaker 33 ₁₃.

Thus for example FIG. 10 shows that where the recording or captureapparatus has been rotated by 180 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 901 the left channel audio signal R is output on the firstspeaker 33 ₁₁ and the right channel audio signal L is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 903 the left channel audio signal R is output onthe third speaker 33 ₁₃ and the right channel audio signal L is outputon the first speaker 33 ₁₁. Where the playback apparatus or receiver isrotated by 180 degrees 905 the left channel audio signal R is output onthe second speaker 33 ₁₂ and the right channel audio signal L is outputon the first speaker 33 ₁₁. Furthermore where the playback apparatus orreceiver is rotated by 270 degrees 907 the left channel audio signal Ris output on the first speaker 33 ₁₁ and the right channel audio signalL is output on the third speaker 33 ₁₃.

Thus for example FIG. 11 shows that where the recording or captureapparatus has been rotated by 270 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 1001 the left channel audio signal L is output on the firstspeaker 33 ₁₁ and the right channel audio signal L′ is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 1003 the left channel audio signal L is output onthe third speaker 33 ₁₃ and the right channel audio signal L′ is outputon the first speaker 33 ₁₁. Where the playback apparatus or receiver isrotated by 180 degrees 1005 the left channel audio signal L is output onthe second speaker 33 ₁₂ and the right channel audio signal L′ is outputon the first speaker 33 ₁₁. Furthermore where the playback apparatus orreceiver is rotated by 270 degrees 1007 the left channel audio signal Lis output on the first speaker 33 ₁₁ and the right channel audio signalL′ is output on the third speaker 33 ₁₃.

A further example audio input to output configuration situations can beshown with respect to FIGS. 12 to 15 where an example 2 microphoneconfiguration for the capture or recording apparatus is shown fororientation steps of 90° and an example 2 speaker configuration for theplayback or rendering apparatus is shown for orientation steps of 90°.

Thus for example FIG. 12 shows that where the capture or recordingapparatus and the playback apparatus or receiver both are in initialorientation 1101 the left channel audio signal L is output on the firstspeaker 33 ₁₁ and the right channel audio signal R is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 1103 the orientation of the playback apparatus issuch that there is no horizontal separation between the first speaker 33₁₁ and second speaker 33 ₁₂ and therefore only a mono mixed version ofthe combined left channel audio signal L and right channel audio signalR (L+R) is output on both the first speaker 33 ₁₁ and second speaker 33₁₂. Where the playback apparatus or receiver is rotated by 180 degrees1105 the left channel audio signal L is output on the second speaker 33₁₂ and the right channel audio signal R is output on the first speaker33 ₁₁. Furthermore where the playback apparatus or receiver is rotatedby 270 degrees 1107 the orientation of the playback apparatus is suchthat there is no horizontal separation between the first speaker 33 ₁₁and second speaker 33 ₁₂ and therefore only a mono mixed version of thecombined left channel audio signal L and right channel audio signal R(L+R) is output on both the first speaker 33 ₁₁ and second speaker 33₁₂.

Thus for example FIG. 13 shows that where the recording or captureapparatus has been rotated by 90 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 1201 the AOS data causes a mono mixed version of thecombined left channel audio signal L and right channel audio signal R(L+R) to be output on both the first speaker 33 ₁₁ and second speaker 33₁₂. When the AOS signal indicates vertical capture, the playbackapparatus or receiver treats the received signals (in this examplefigure and in other example figures below) as captured by microphonespositioned vertically with respect to each other. Where the playbackapparatus or receiver is rotated by 90 degrees 1203 the AOS data causesthe left channel audio signal L to be output on the first speaker 33 ₁₁and the right channel audio signal R to be output on the second speaker33 ₁₂. In such a manner the receiver is configured to output thereceived audio signals as a vertical stereo output. Where the playbackapparatus or receiver is rotated by 180 degrees 1205 the AOS data causesa mono mixed version of the combined left channel audio signal L andright channel audio signal R (DR) to be output on both the first speaker33 ₁₁ and second speaker 33 ₁₂. Furthermore where the playback apparatusor receiver is rotated by 270 degrees 1207 the AOS data causes the leftchannel audio signal L to be output on the second speaker 33 ₁₂ and theright channel audio signal R to be output on the first speaker 33 ₁₁ andtherefore to output the received audio signals as a vertical stereooutput.

Thus for example FIG. 14 shows that where the recording or captureapparatus has been rotated by 180 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 1301 the left channel audio signal R is output on the firstspeaker 33 ₁₁ and the right channel audio signal L is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 1303 the orientation of the playback apparatus issuch that there is no horizontal separation between the first speaker 33₁₁ and second speaker 33 ₁₂ and therefore only a mono mixed version ofthe combined left channel audio signal R and right channel audio signalL (L+R) is output on both the first speaker 33 ₁₁ and second speaker 33₁₂. Where the playback apparatus or receiver is rotated by 180 degrees1305 the left channel audio signal R is output on the second speaker 33₁₂ and the right channel audio signal L is output on the first speaker33 ₁₁. Furthermore where the playback apparatus or receiver is rotatedby 270 degrees 1307 the orientation of the playback apparatus is suchthat there is no horizontal separation between the first speaker 33 ₁₁and second speaker 33 ₁₂ and therefore only a mono mixed version of thecombined left channel audio signal R and right channel audio signal L(L+R) is output on both the first speaker 33 ₁₁ and second speaker 33₁₂.

Thus for example FIG. 15 shows that where the recording or captureapparatus has been rotated by 270 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 1401 the AOS data causes a mono mixed version of thecombined left channel audio signal R and right channel audio signal L(L+R) to be output on both the first speaker 33 ₁₁ and second speaker 33₁₂. Where the playback apparatus or receiver is rotated by 90 degrees1403 the AOS data causes the left channel audio signal R to be output onthe first speaker 33 ₁₁ and the right channel audio signal L to beoutput on the second speaker 33 ₁₂. In such a manner the receiver isconfigured to output the received audio signals as a vertical stereooutput. Where the playback apparatus or receiver is rotated by 180degrees 1405 the AOS data causes a mono mixed version of the combinedleft channel audio signal R and right channel audio signal L (L+R) to beoutput on both the first speaker 33 ₁₁ and second speaker 33 ₁₂.Furthermore where the playback apparatus or receiver is rotated by 270degrees 1407 the AOS data causes the left channel audio signal R to beoutput on the second speaker 33 ₁₂ and the right channel audio signal Lto be output on the first speaker 33 ₁₁ the left channel audio signal L′is output on the first speaker 33 ₁₁ and therefore to output thereceived audio signals as a vertical stereo output.

A further example audio input to output configuration situations can beshown with respect to FIGS. 16 to 19 where an example 2 microphoneconfiguration for the capture or recording apparatus is shown fororientation steps of 90° and an example 3 speaker configuration for theplayback or rendering apparatus is shown for orientation steps of 90°.

Thus for example FIG. 16 shows that where the capture or recordingapparatus and the playback apparatus or receiver both are in initialorientation 1501 the left channel audio signal L is output on the firstspeaker 33 ₁₁ and the right channel audio signal R is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 1503 the left channel audio signal L is output onthe third speaker 33 ₁₃ and the right channel audio signal R is outputon the first speaker 33 ₁₁. Where the playback apparatus or receiver isrotated by 180 degrees 1505 the left channel audio signal L is output onthe second speaker 33 ₁₂ and the right channel audio signal R is outputon the first speaker 33 ₁₁. Furthermore where the playback apparatus orreceiver is rotated by 270 degrees 1507 the left channel audio signal Lis output on the first speaker 33 ₁₁ and the right channel audio signalR is output on the third speaker 33 ₁₃.

Thus for example FIG. 17 shows that where the recording or captureapparatus has been rotated by 90 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 1601 the AOS data causes the left channel audio signal L tobe output on the first speaker 33 ₁₁ and the right channel audio signalR to be output on the third speaker 33 ₁₃. Thus in such a manner thereceiver is configured to output the received audio signals as avertical stereo output and produce a better quality output. Where theplayback apparatus or receiver is rotated by 90 degrees 1603 the AOSdata causes the left channel audio signal L to be output on the firstspeaker 33 ₁₁ and the right channel audio signal R to be output on thesecond speaker 33 ₁₂. Therefore the receiver is configured to output thereceived audio signals as an improved quality vertical stereo output.Where the playback apparatus or receiver is rotated by 180 degrees 1605the AOS data causes the left channel audio signal L to be output on thethird speaker 33 ₁₃ and the right channel audio signal R to be output onthe first speaker 33 ₁₁. Thus in such a manner the receiver is alsoconfigured to output the received audio signals as a vertical stereooutput and produce a better quality output. Furthermore where theplayback apparatus or receiver is rotated by 270 degrees 1607 the AOSdata causes the left channel audio signal L to be output on the secondspeaker 33 ₁₂ and the right channel audio signal R to be output on thefirst speaker 33 ₁₁ and therefore to output the received audio signalsas a vertical stereo output.

Thus for example FIG. 18 shows that where the recording or captureapparatus has been rotated by 180 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 1701 the left channel audio signal R is output on the firstspeaker 33 ₁₁ and the right channel audio signal L is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 1703 the left channel audio signal R is output onthe third speaker 33 ₁₃ and the right channel audio signal L is outputon the first speaker 33 ₁₁. Where the playback apparatus or receiver isrotated by 180 degrees 1705 the left channel audio signal R is output onthe second speaker 33 ₁₂ and the right channel audio signal L is outputon the first speaker 33 ₁₁. Furthermore where the playback apparatus orreceiver is rotated by 270 degrees 1707 the left channel audio signal Ris output on the first speaker 33 ₁₁ and the right channel audio signalL is output on the third speaker 33 ₁₃.

Thus for example FIG. 19 shows that where the recording or captureapparatus has been rotated by 270 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 1801 the AOS data causes the left channel audio signal R tobe output on the first speaker 33 ₁₁ and the right channel audio signalL to be output on the third speaker 33 ₁₃. Thus in such a manner thereceiver is configured to output the received audio signals as avertical stereo output and produce a better quality output. Where theplayback apparatus or receiver is rotated by 90 degrees 1803 the AOSdata causes the left channel audio signal R to be output on the firstspeaker 33 ₁₁ and the right channel audio signal L to be output on thesecond speaker 33 ₁₂. Therefore the receiver is configured to output thereceived audio signals as an improved quality vertical stereo output.Where the playback apparatus or receiver is rotated by 180 degrees 1805the AOS data causes the left channel audio signal R to be output on thethird speaker 33 ₁₃ and the right channel audio signal L to be output onthe first speaker 33 ₁₁. Thus in such a manner the receiver is alsoconfigured to output the received audio signals as a vertical stereooutput and produce a better quality output. Furthermore where theplayback apparatus or receiver is rotated by 270 degrees 1807 the AOSdata causes the left channel audio signal R to be output on the secondspeaker 33 ₁₂ and the right channel audio signal L to be output on thefirst speaker 33 ₁₁ and therefore to output the received audio signalsas a vertical stereo output.

The fourth example audio input to output configuration situations can beshown with respect to FIGS. 20 to 23 where an example 3 microphoneconfiguration for the capture or recording apparatus is shown fororientation steps of 90° and an example 2 speaker configuration for theplayback or rendering apparatus is shown for orientation steps of 90°.

Thus for example FIG. 20 shows that where the capture or recordingapparatus and playback apparatus or receiver both are in initialorientation 1901 the left channel audio signal L is output on the firstspeaker 33 ₁₁ and the right channel audio signal R is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 1903 the orientation of the playback apparatus issuch that there is no horizontal separation between the first speaker 33₁₁ and second speaker 33 ₁₂ and therefore only a mono mixed version ofthe combined left channel audio signal L and right channel audio signalR (L+R) is output on both the first speaker 33 ₁₁ and second speaker 33₁₂. In other words a mono mixed output is provided. Where the playbackapparatus or receiver is rotated by 180 degrees 1905 the left channelaudio signal L is output on the second speaker 33 ₁₂ and the rightchannel audio signal R is output on the first speaker 33 ₁₁. Furthermorewhere the playback apparatus or receiver is rotated by 270 degrees 1907the orientation of the playback apparatus is also such that there is nohorizontal separation between the first speaker 33 ₁₁ and second speaker33 ₁₂ and therefore only a mono mixed version of the combined leftchannel audio signal L and right channel audio signal R (L+R) is outputon both the first speaker 33 ₁₁ and second speaker 33 ₁₂.

Thus for example FIG. 21 shows that where the recording or captureapparatus has been rotated by 90 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 2001 the left channel audio signal L′ is output on the firstspeaker 33 ₁₁ and the right channel audio signal L is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 2003 the orientation of the playback apparatus issuch that there is no horizontal separation between the first speaker 33₁₁ and second speaker 33 ₁₂ and therefore only a mono mixed version ofthe combined left channel audio signal L′ and right channel audio signalL (L+L′) is output on both the first speaker 33 ₁₁ and second speaker 33₁₂. Where the playback apparatus or receiver is rotated by 180 degrees2005 the left channel audio signal L′ is output on the second speaker 33₁₂ and the right channel audio signal L is output on the first speaker33 ₁₁. Furthermore where the playback apparatus or receiver is rotatedby 270 degrees 2007 the orientation of the playback apparatus is suchthat there is no horizontal separation between the first speaker 33 ₁₁and second speaker 33 ₁₂ and therefore only a mono mixed version of thecombined left channel audio signal L′ and right channel audio signal L(L+L′) is output on both the first speaker 33 ₁₁ and second speaker 33₁₂.

Thus for example FIG. 22 shows that where the recording or captureapparatus has been rotated by 180 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 2101 the left channel audio signal R is output on the firstspeaker 33 ₁₁ and the right channel audio signal L is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 2103 the orientation of the playback apparatus issuch that there is no horizontal separation between the first speaker 33₁₁ and second speaker 33 ₁₂ and therefore only a mono mixed version ofthe combined left channel audio signal R and right channel audio signalL (R+L) is output on both the first speaker 33 ₁₁ and second speaker 33₁₂. Where the playback apparatus or receiver is rotated by 180 degrees2105 the left channel audio signal R is output on the second speaker 33₁₂ and the right channel audio signal L is output on the first speaker33 ₁₁. Furthermore where the playback apparatus or receiver is rotatedby 270 degrees 2107 the orientation of the playback apparatus is suchthat there is no horizontal separation between the first speaker 33 ₁₁and second speaker 33 ₁₂ and therefore only a mono mixed version of thecombined left channel audio signal R and right channel audio signal L(R+L) is output on both the first speaker 33 ₁₁ and second speaker 33₁₂.

Thus for example FIG. 23 shows that where the recording or captureapparatus has been rotated by 270 degrees clockwise from the initialposition and where the playback apparatus or receiver is in initialorientation 2201 the left channel audio signal L is output on the firstspeaker 33 ₁₁ and the right channel audio signal L′ is output on thesecond speaker 33 ₁₂. Where the playback apparatus or receiver isrotated by 90 degrees 2203 the orientation of the playback apparatus issuch that there is no horizontal separation between the first speaker 33₁₁ and second speaker 33 ₁₂ and therefore only a mono mixed version ofthe combined left channel audio signal L and right channel audio signalL′ (L+L′) is output on both the first speaker 33 ₁₁ and second speaker33 ₁₂. Where the playback apparatus or receiver is rotated by 180degrees 2205 the left channel audio signal L is output on the secondspeaker 33 ₁₂ and the right channel audio signal L′ is output on thefirst speaker 33 ₁₁. Furthermore where the playback apparatus orreceiver is rotated by 270 degrees 2207 the orientation of the playbackapparatus is such that there is no horizontal separation between thefirst speaker 33 ₁₁ and second speaker 33 ₁₂ and therefore only a monomixed version of the combined left channel audio signal L and rightchannel audio signal L′ (L+L′) is output on both the first speaker 33 ₁₁and second speaker 33 ₁₂.

During the recording the capturing device may be rotated in severalsubsequent rotations and each rotation may change the orientation of theaudio capture, first from the initial orientation to a new orientationand then later from the new orientation to a further new orientation.The disclosed method may be applied for each rotation to ensure thataudio playback orientation is aligned with the recording orientation. Inother words the capture device can determine a difference in orientationfrom a determined orientation and an earlier orientation. In somesituations the earlier orientation can be an initial orientation.

With respect to FIGS. 26 to 28 example system overview operations areshown as flow charts.

For example in some embodiments the system apparatus are configured todetect the orientation of audio capture (xxx degrees) in the sendingdevice as shown in FIG. 26 in step 2501

Furthermore the recording or capture apparatus in some embodiments isconfigured to send the orientation of audio capture (xxx degrees) to thereceiving device with suitable granularity (and based on the accuracy ofthe gravitation detector in the recording apparatus). This is shown inFIG. 26 in step 2503.

In some embodiments the playback within the receiving apparatus isconfigured to use the speakers best corresponding to the orientation ofthe audio capture. If suitably oriented speakers are not available, thena fall-back from stereo to mono or from surround sound to stereoplayback is generated. This is shown in FIG. 26 by step 2505.

In some embodiments, such as shown in the flow chart in FIG. 27, thesending or recording apparatus is configured to determine or detect theorientation of audio capture (defined as either vertical or horizontal)within the sending apparatus. The recording apparatus orientationdetermination is shown in FIG. 27 by step 2601.

The sending apparatus can then in some embodiments send the orientationof audio capture (vertical or horizontal) to the receiving or playbackapparatus. The operation of sending the orientation of audio capture isshown in FIG. 27 by step 2603.

In some embodiments the playback of the audio signals in the receivingapparatus is configured such that the playback apparatus uses thespeakers best corresponding to the orientation of the audio capture. Ifsuitably oriented speakers are not available, then the playbackapparatus can be configured to fall-back from stereo to mono. In otherwords for

Horizontal Audio Capture:

Play audio out from horizontally positioned speakers (with the left andright hand side signals as in the capture). If the available speakersare positioned vertically, play out mono from them.

Vertical Audio Capture:

Play audio out from vertically positioned speakers (with the top andbottom signals as in the capture). If the available speakers arepositioned horizontally, play out mono from them.

The use of suitably orientated speakers is shown in FIG. 27 by step2605.

Note that if only binary information on audio orientation (horizontalvs. vertical) as shown in FIG. 27 is sent (one bit), capturing andrendering devices are synchronised to use the same audio output order.In other words both the capturing and the rendering devices areconfigured to know which signal is sent first in horizontal capture (forexample is the audio output order “left, right” or “right, left”) and invertical capture (for example is the audio output order: “top, bottom”or “bottom, top”). The synchronisation information is required toprevent the audio playback having the possibility of an error of 180degrees.

Table I shows examples of the application of the embodiments shown inFIG. 27 describing the relationship between capture device orientation,audio (capture) orientation and audio output order for some of theexamples illustrated in the Figures. In such circumstances the audioorientation is signalled via AOS from the sending device to thereceiving device when deviation from the default (horizontal orientationin this example embodiment) occurs. In other words audio orientation issignalled via AOS from the sending device to the receiving device forthe cases marked with star (*) in the Table. Audio output order is alsomade known to both the sending and receiving device, for example by alsoit being sent from the sending device to the receiving device.

TABLE I Example of the relationship between capture device orientation,audio (capture) orientation and audio output order. Audio (capture)Audio output order Orientation of orientation (sig- (made known to Casecapture apparatus nalled via AOS) sender and receiver) FIG. 8 0 degreesHorizontal L, R, (L′) FIG. 9 90 degrees Horizontal L′, L, (R) FIG. 10180 degrees Horizontal R, L, (L′) FIG. 11 270 degrees Horizontal L, L′,(R) FIG. 12 0 degrees Horizontal L, R FIG. 13 90 degrees Vertical * L, RFIG. 14 180 degrees Horizontal R, L FIG. 15 270 degrees Vertical * R, L

It would be understood that in some embodiments sending two (monophonic)audio signals from the capturing device to the receiving or renderingdevice is sufficient for reproducing stereo (for vertical and horizontalorientation), and therefore knowledge of the two first components in theaudio output order is sufficient and reflected by the third componentbeing shown inside brackets in the table.

In one embodiment, the sending device has only two microphones (shown inFIGS. 12-15). In these cases the audio output order can be signalledwith only one bit.

In some embodiments the sending (recording or capture) apparatus isconfigured to determine or detect the orientation of audio capture (0,90, 180, or 270 degrees) in the sending apparatus. The detecting of theorientation is shown in FIG. 28 by step 2701.

Furthermore in some embodiments the sending apparatus can be configuredto send the orientation of audio capture (0, 90, 180, or 270 degrees) tothe receiving apparatus via AOS. The operation of sending theorientation information is shown in FIG. 28 by step 2703.

In such embodiments the receiving device is configured to playback theaudio signal and further configured to use the speakers bestcorresponding to the orientation of the audio capture. If suitablyoriented speakers are not available then the receiving apparatus isconfigured to fall-back from stereo to mono or from surround sound tostereo play out or in general to downmixing audio from multi channels tofewer channels. This can be shown as the following operations

0 Degrees Audio Capture (Horizontal):

Play audio captured by microphones L (or L′ which may happen in the 3microphone case) (on the left hand side of the device) and R (or L) (onthe right hand side of the device) out from horizontally positionedspeakers on the left and right hand sides of the device, respectively.If the available speakers are positioned vertically, play out mono fromthem.

90 Degrees Audio Capture Rotation (Vertical):

Play audio captured by microphones L (on the top of the device) and R(on the bottom of the device) out from vertically positioned speakers onthe top and bottom of the device, respectively. If the availablespeakers are positioned only horizontally, play out mono from them.

180 Degrees Audio Capture Rotation (Horizontal Reversed):

Play audio captured by microphones R (or L) (on the left hand side ofthe device) and L (or L′) (on the right hand side of the device) outfrom horizontally positioned speakers on the left and right hand sidesof the device, respectively. If the available speakers are positionedonly vertically, play out mono from them.

270 Degrees Audio Capture Rotation (Vertical Reversed):

Play audio captured by microphones R (on the top of the device) and L(on the bottom of the device) out from vertically positioned speakers onthe top and bottom of the device, respectively. If the availablespeakers are positioned only horizontally, play out mono from them.

The operation of performing playback of the audio signal using thespeakers best corresponding to the orientation of the audio capture isshown in FIG. 28 by step 2705.

Note that in some embodiments, for example the operations performed asshown in the case of FIG. 28, the audio output order within horizontaland vertical capture can be included into the above (2 bit) AOSsignalling via the choice of 0 vs. 180 degrees for horizontal captureand 90 vs. 270 degrees for vertical capture. In such embodiments, theaudio output order for the two signals forming stereo is signalled bythe AOS data. In such embodiments the compact signalling requires thatthe capturing device (where the capturing device has more than 2microphones) only sends the two signals sufficient for producing stereo(in other words in the case where there are three microphones thecapturing device drops the signals shown inside brackets in Table I fromthe bit-stream from being sent to the receiving device).

Table II shows examples of the application of the embodiments shown inFIG. 28 of the relationship between capture device orientation and audio(capture) orientation. Audio orientation in such embodiments is sent viaAOS when deviation from the default (horizontal non-reversed orientationin this example embodiment) occurs. In other words the audio orientationis sent in the cases marked with star (*) in the following table.

TABLE II Example of the relationship between capture device orientationand audio (capture) orientation. Audio (capture) Orientation oforientation (sig- Case capture apparatus nalled via AOS) FIG. 8 0degrees Horizontal FIG. 9 90 degrees Horizontal FIG. 10 180 degreesHorizontal reversed * FIG. 11 270 degrees Horizontal reversed * FIG. 120 degrees Horizontal FIG. 13 90 degrees Vertical * FIG. 14 180 degreesHorizontal reversed * FIG. 15 270 degrees Vertical reversed *

In some embodiments a particular audio capture orientation (for examplehorizontal audio capture orientation) can be preferred. In someembodiments the preferred audio capture orientation can be used (inother words signalled by AOS) even though the audio capture orientationis closer to another orientation. For example in some embodiments ahorizontal audio capture orientation can be used (in other wordssignalled via AOS) even though the difference from horizontalorientation exceeds 45 degrees.

In some embodiments, where the receiving device is capable of playingout the audio signal only with lower granularity of orientation thanwhat is signalled via AOS, the receiving device may use for play out theclosest orientation it supports (possibly with preference for a certainorientation such as horizontal). In some embodiments the receivingdevice can further prefer a specific output format, for example stereoplayout, rather than switching to play the signal as mono, or in someembodiments the receiving device may simultaneously play out the audiosignal from more than one speaker with suitable scaling applied for theplayout for each speaker making the audio signal to appear as comingfrom between the speakers (i.e. from orientations between the speakers).

It would be understood that the speakers can comprise any suitable audiotransducer output device including loudspeakers; headphones; headsets;earpieces; external loudspeakers; and integrated hands free speakers.

It shall be appreciated that the term user equipment is intended tocover any suitable type of wireless user equipment, such as mobiletelephones, portable data processing devices or portable web browsers,as well as wearable devices.

In general, the various embodiments of the invention may be implementedin hardware or special purpose circuits, software, logic or anycombination thereof. For example, some aspects may be implemented inhardware, while other aspects may be implemented in firmware or softwarewhich may be executed by a controller, microprocessor or other computingdevice, although the invention is not limited thereto. While variousaspects of the invention may be illustrated and described as blockdiagrams, flow charts, or using some other pictorial representation, itis well understood that these blocks, apparatus, systems, techniques ormethods described herein may be implemented in, as non-limitingexamples, hardware, software, firmware, special purpose circuits orlogic, general purpose hardware or controller or other computingdevices, or some combination thereof.

The embodiments of this invention may be implemented by computersoftware executable by a data processor of the mobile device, such as inthe processor entity, or by hardware, or by a combination of softwareand hardware. Further in this regard it should be noted that any blocksof the logic flow as in the Figures may represent program steps, orinterconnected logic circuits, blocks and functions, or a combination ofprogram steps and logic circuits, blocks and functions. The software maybe stored on such physical media as memory chips, or memory blocksimplemented within the processor, magnetic media such as hard disk orfloppy disks, and optical media such as for example DVD and the datavariants thereof, CD.

The memory may be of any type suitable to the local technicalenvironment and may be implemented using any suitable data storagetechnology, such as semiconductor-based memory devices, magnetic memorydevices and systems, optical memory devices and systems, fixed memoryand removable memory. The data processors may be of any type suitable tothe local technical environment, and may include one or more of generalpurpose computers, special purpose computers, microprocessors, digitalsignal processors (DSPs), application specific integrated circuits(ASIC), gate level circuits and processors based on multi-core processorarchitecture, as non-limiting examples.

Embodiments of the inventions may be practiced in various componentssuch as integrated circuit modules. The design of integrated circuits isby and large a highly automated process. Complex and powerful softwaretools are available for converting a logic level design into asemiconductor circuit design ready to be etched and formed on asemiconductor substrate.

Programs, such as those provided by Synopsys, Inc. of Mountain View,Calif. and Cadence Design, of San Jose, Calif. automatically routeconductors and locate components on a semiconductor chip using wellestablished rules of design as well as libraries of pre-stored designmodules. Once the design for a semiconductor circuit has been completed,the resultant design, in a standardized electronic format (e.g., Opus,GDSII, or the like) may be transmitted to a semiconductor fabricationfacility or “fab” for fabrication.

The foregoing description has provided by way of exemplary andnon-limiting examples a full and informative description of theexemplary embodiment of this invention. However, various modificationsand adaptations may become apparent to those skilled in the relevantarts in view of the foregoing description, when read in conjunction withthe accompanying drawings and the appended claims. However, all such andsimilar modifications of the teachings of this invention will still fallwithin the scope of this invention as defined in the appended claims.

The invention claimed is:
 1. A method comprising: generating at leasttwo audio signals respectively from at least two microphones, a first ofthe at least two audio signals captured at a first microphone positionedat a first location and a second of the at least two audio signalscaptured at a second microphone positioned at a second location, thefirst microphone having a relative displacement with respect to thesecond microphone; determining an audio capture orientation based onlocation information of the at least two microphones, the audio captureorientation being associated with the at least two audio signals fromthe at least two microphones including the relative displacement betweenthe first microphone and the second microphone, wherein the audiocapture orientation or an indication associated with the audio captureorientation enables playback of the at least two audio signals to beprocessed based on the audio capture orientation or the indicationassociated with the audio capture orientation such that the playback ofthe at least two audio signals is aligned to an arrangement of the atleast two microphones when capturing the at least two audio signals; andreproducing the at least two audio signals having the alignedarrangement during playback.
 2. The method as claimed in claim 1,further comprising: determining, if a difference between an orientationvalue of the audio capture orientation and an earlier orientation valueof the audio capture orientation is greater than a defined value; andoutputting the orientation value of the audio capture orientation or theindication associated with the audio capture orientation with the atleast two audio signals, such that the playback of the at least twoaudio signals is performed based on the orientation value of the audiocapture orientation or the indication associated with the audio captureorientation with the at least two audio signals.
 3. The method asclaimed in claim 1, further comprising: determining, an audio outputorder for the at least two audio signals based on the audio captureorientation or the indication associated with the audio captureorientation with the at least two audio signals; and outputting, theaudio output order with the at least two audio signals, such that theplayback of the at least two audio signals is further performed based onthe audio output order.
 4. The method as claimed in claim 3, furthercomprising: determining, a difference between the orientation value ofthe audio capture orientation and an earlier orientation value of theaudio capture orientation is greater than a defined audio outputre-ordering value, and triggering, the determining of the audio outputorder when the difference between the orientation value of the audiocapture orientation and the earlier orientation value of the audiocapture orientation is greater than the defined audio output re-orderingvalue.
 5. The method as claimed in claim 1, wherein generating, the atleast two audio signals comprises: generating the first of the at leasttwo audio signals with the first microphone at the first location; andgenerating the second of the at least two audio signals with the secondmicrophone at the second location, the relative displacement between thefirst microphone and the second microphone being the displacementbetween the first location and the second location.
 6. The method asclaimed in claim 1, wherein generating, the at least two audio signalscomprises at least one of: receiving the at least two audio signals froma remote apparatus comprising at least two microphones having therelative displacement; and receiving the at least two audio signals froma memory.
 7. The method as claimed in claim 1, further caused to:receive configuration information associated with the at least twomicrophones; and determine the audio capture orientation based on theconfiguration information, wherein the configuration informationcomprises information related to a number of microphones, location ofthe microphones and relative positioning of the microphones to eachother, or capture directionality of the microphones.
 8. A methodcomprising: receiving, by a playback device, at least two audio signalsrespectively from at least two microphones with audio captureorientation information, the audio capture orientation information beingassociated with the at least two audio signals from the at least twomicrophones including a relative displacement between a first microphoneand a second microphone, wherein a first of the at least two audiosignals is captured at the first microphone positioned at a firstlocation and a second of the at least two audio signals is captured atthe second microphone positioned at a second location, the firstmicrophone having the relative displacement with respect to the secondmicrophone, wherein the audio capture orientation information or anindication associated with the audio capture orientation informationenables playback of at least two speakers to be processed based on theaudio capture orientation information or the indication associated withthe audio capture orientation information such that playback of the atleast two audio signals is aligned to an arrangement of the at least twomicrophones when capturing the at least two audio signals; andreproducing the at least two audio signals for outputting to the atleast two speakers having the aligned arrangement during playback. 9.The method as claimed in claim 8, further comprises processing the atleast two audio signals according to an initial audio output order. 10.The method as claimed in claim 8, further comprising: receiving an audiooutput order for the at least two audio signals; and processing the atleast two audio signals such that the playback of the at least two audiosignals is further performed based on the audio output order.
 11. Themethod as claimed in claim 8, wherein outputting the at least two audiosignals to at least two speakers comprises at least one of: routing theat least two audio signals to the at least two speakers based on theplayback orientation; and mixing the at least two audio signals togenerate a downmixed audio signal to be output to at least one of the atleast two speakers.
 12. An apparatus comprising at least one processorand at least one memory including computer code for one or moreprograms, the at least one memory and the computer code configured towith the at least one processor cause the apparatus to at least:generate at least two audio signals respectively from at least twomicrophones, a first of the at least two audio signals captured at afirst microphone positioned at a first location and a second of the atleast two audio signals captured at a second microphone positioned at asecond location, the first microphone having a relative displacementwith respect to the second microphone; determine an audio captureorientation based on location information of the at least twomicrophones, the audio capture orientation being associated with the atleast two audio signals from the at least two microphones including therelative displacement between the first microphone and the secondmicrophone, wherein the audio capture orientation or an indicationassociated with the audio capture orientation enables playback of the atleast two audio signals to be processed based on the audio captureorientation or the indication associated with the audio captureorientation such that the playback of the at least two audio signals isaligned to an arrangement of the at least two microphones when capturingthe at least two audio signals; and reproduce the at least two audiosignals having the aligned arrangement during playback.
 13. Theapparatus as claimed in claim 12, further caused to: determine, if adifference between an orientation value of the audio capture orientationand an earlier orientation value of the audio capture orientation isgreater than a defined value; and output the orientation value of theaudio capture orientation or the indication associated with the audiocapture orientation with the at least two audio signals, such that theplayback of the at least two audio signals is performed based on theorientation value of the capture orientation or the indicationassociated with the audio capture orientation with the at least twoaudio signals.
 14. The apparatus as claimed in claim 12, further causedto perform: determine, an audio output order for the at least two audiosignals based on the audio capture orientation or the indicationassociated with the audio capture orientation with the at least twoaudio signals; and output, the audio output order with the at least twoaudio signals, such that the playback of the at least two audio signalsis further performed based on the audio output order.
 15. The apparatusas claimed in claim 14, further caused to: determine, a differencebetween the orientation value of the audio capture orientation and anearlier orientation value of the audio capture orientation is greaterthan a defined audio output re-ordering value, and trigger, thedetermining of the audio output order when the difference between theorientation value of the audio capture orientation and the earlierorientation value of the audio capture orientation is greater than thedefined audio output re-ordering value.
 16. The apparatus as claimed inclaim 12, further caused to: generate the first of the at least twoaudio signals with the first microphone at the first location; andgenerate the second of the at least two audio signals with the secondmicrophone at the second location, the relative displacement between thefirst microphone and the second microphone being the displacementbetween the first location and the second location.
 17. The apparatus asclaimed in claim 12, further caused to: receive the at least two audiosignals from a remote apparatus comprising at least two microphoneshaving the relative displacement.
 18. An apparatus comprising at leastone processor and at least one memory including computer code for one ormore programs, the at least one memory and the computer code configuredto with the at least one processor cause the apparatus to: receive atleast two audio signals respectively from at least two microphones withaudio capture orientation information, the audio capture orientationinformation being associated with the at least two audio signals fromthe at least two microphones including a relative displacement between afirst microphone and a second microphone, wherein a first of the atleast two audio signals is captured at the first microphone positionedat a first location and a second of the at least two audio signals iscaptured at the second microphone positioned at a second location, thefirst microphone having the relative displacement with respect to thesecond microphone, wherein the audio capture orientation information oran indication associated with the audio capture orientation informationenables playback of at least two speakers to be processed based on theaudio capture orientation information or the indication associated withthe audio capture orientation information such that playback of the atleast two audio signals is aligned to an arrangement of the at least twomicrophones when capturing the at least two audio signals; and reproducethe at least two audio signals for outputting to the at least twospeakers having the aligned arrangement during playback.
 19. Theapparatus as claimed in claim 18, further comprises processing the atleast two audio signals according to an initial audio output order. 20.The apparatus as claimed in claim 18, further caused to perform: receivean audio output order for the at least two audio signals; and processthe at least two audio signals such that the playback of the at leasttwo audio signals is further performed based on the audio output order.21. The apparatus as claimed in claim 18, further caused to output theat least two audio signals to at least two speakers by at least: routingthe at least two audio signals to the at least two speakers based on theplayback orientation; and mixing the at least two audio signals togenerate a downmixed audio signal to be output to at least one of the atleast two speakers.